Method and Apparatus For Large 
Payload Distribution in a Network 

Abstract of Disclosure 

Large payload files are selectively partitioned in blocks and the blocks distributed 
to a plurality of distribution stations at the edge of the network qualified to have the 
data. Each qualified station decides how much and what portion of the content to save 
locally, based on information such as network location and environment, usage, 
popularity, and other distribution criteria defined by the content provider. Different 
pieces of a large payload file may be available from different nodes, however, when a 
user requests access to the large payload file, for example, through an application 
server, a virtual file control system creates an illusion that the entire file is present at 
the connected node. However, since only selective portions of the large payload file 
may actually be resident at that node's storage at the time of request, a cluster of 
distribution servers at the distribution station may download the non-resident 
portions of the file as the application server is servicing the user. The download may 
be in parallel and usually from the least congested nodes. New nodes added to the 
network learn from other nodes in the network what content they should have and 
download the required content, in a desired amount, onto their local storage devices 
from the nearest and least congested nodes without interrupting network operation. 
Each node manages its local storage and decides what content to prune based on 
information such as usage patterns. 
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